dbe172050b82f6b45924741e3071379571981051
flan-t5-base huggingface-transformers t5
- challenge
- CAICCAIC: Centre for Artificial Intelligence Challenge on Conversational AI Correctness
- submitter
- s478839
- submitted
- 2023-06-11 20:43:55.724964 UTC
- file basename
- out
test-A / 8db720eb6143e41b2746032694c05dd5e8315375
| Metric | Score |
|---|---|
| Exact Match Accuracy | 9.963313380961576e-2 |
| Domain accuracy | 0.9449700714423633 |
| Intent accuracy | 0.7093068159876424 |
| Slot WRR | 8.914245333998416e-2 |
| en-US | es-ES | pl-PL | |
|---|---|---|---|
| Exact Match Accuracy | 0.14055023923444976 | 7.130681818181818e-2 | 8.900973096737264e-2 |
| Domain accuracy | 0.8833732057416268 | 0.9840909090909091 | 0.9645105895821409 |
| Intent accuracy | 0.6214114832535885 | 0.7227272727272728 | 0.7799084144247281 |
| Slot WRR | 8.685121107266436e-2 | 6.969724686728251e-2 | 0.11989379084967322 |